General unifying features of controlled quantum phenomena 
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Many proposals have been put forth for controlling quantum phenomena, including open-loop, adaptive feed- 
back, and real-time feedback control. Each of these approaches has been viewed as operationally, and even 
physically, distinct from the others. This work shows that all such scenarios inherently share the same funda- 
mental control features residing in the topology of the landscape relating the target physical observable to the 
applied controls. This unified foundation may provide a basis for development of hybrid control schemes that 
would combine the advantages of the existing approaches to achieve the best overall performance. 
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Steering the dynamics of quantum systems by means of ex- 
ternal controls is a central goal in many areas of modern sci- 
ence, ranging from the creation of selective molecular trans- 
formations to quantum information processing [1]. The con- 
trol may be either coherent (e.g., a shaped laser pulse [2-6]) 
or incoherent (e.g., a tailored environment [7] or a sequence 
of quantum measurements [8]). Quantum control is proving 
to be successful in the laboratory for manipulating a broad 
variety of physical, chemical, and biologically relevant pro- 
cesses [1, 5, 6]. 

Many seemingly distinct approaches have been developed 
for controlling quantum phenomena [9], including open-loop 
control (OLC) in which model-based designs are directly ap- 
plied in experiments [3], adaptive feedback control (AFC) 
which is a measurement-guided closed-loop laboratory proce- 
dure including resetting the system to the initial state on each 
loop iteration [4—6], and real-time feedback control (RTFC) 
which involves quantum measurement back-action on the sys- 
tem upon traversing the loop [10, 11]. Each of these con- 
trol schemes has been argued to be operationally, and even 
physically, distinct from the others. This Rapid Communi- 
cation shows that all such scenarios are unified on a funda- 
mental level by the common character of the control land- 
scape [12, 13] which relates the physical objective J[c] to the 
control variables c. This general foundation makes it possible 
to extend the powerful landscape-based methods of optimal- 
ity analysis, originally developed for OLC and AFC [12], to 
RTFC. Furthermore, one can envision combinations of such 
schemes [9], or even the prospect of new unanticipated ones, 
possibly arising in the future, all of which will share the same 
fundamental control landscape features. 

The structure of the control landscape (i.e., its topology 
characterized by the nature of the local and global extrema) 
determines the efficacy of a search for optimal solutions to the 
posed control problem [14, 15]. Searching for the global max- 
imum of the objective function J[c] in the laboratory would be 
significantly hindered by the existence of local maxima that 
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act as traps during the optimization procedure. Even stochas- 
tic optimization algorithms could be impeded by a high den- 
sity of traps [16]. If the objective function has no traps, then, 
in principle, nothing lies in the way of reaching the global 
maximum (i.e., the best possible yield), except limited con- 
trols. This work establishes that a common landscape topol- 
ogy is shared by all quantum control schemes, leading to two 
general conclusions about controlling quantum phenomena. 
First, there are no local optima to act as traps on the landscape 
for a wide class of control problems, thereby enabling highly 
efficient searches for globally optimal controls. Second, for 
each particular objective J, there exists a single special con- 
trol c* which is universally optimal for all initial states of a 
system; this result implies that provides inherent robust- 
ness to variations of the initial system's state. For practical ap- 
plications, these generic fundamental properties can facilitate 
more flexible laboratory implementations of quantum control 
as well as guide the design of suitable algorithms for labora- 
tory optimization [17]. 

The control landscapes for OLC and AFC were studied in 
recent works [12-15, 18]. For closed quantum systems, a 
control objective J can be cast as a function of unitary evo- 
lution operators. Assuming evolution-operator controllability 
(i.e., that any unitary evolution can be produced by the avail- 
able controls), the landscapes were shown to have no traps for 
typical objectives, including the expectation value of an ob- 
servable [12] and the fidelity of a unitary quantum gate [13]. 
The absence of landscape traps was also analyzed for closed 
systems in the space of actual controls [14]. The landscapes 
for OLC and AFC of open quantum systems can be studied 
by casting an objective as a function of completely positive, 
trace-preserving maps (i.e., Kraus maps [9, 19]) which de- 
scribe the system evolution. Assuming Kraus-map controlla- 
bility (i.e., that any Kraus map can be produced by the avail- 
able controls), the trap-free landscape topology was estab- 
lished for open-system observable control [18]. 

The analysis of the control landscapes for RTFC is per- 
formed below to significantly extend the prior analysis [18] 
and provide a single complete framework unifying the land- 
scapes for all quantum control schemes, including OLC, AFC, 
and RTFC. Two distinct approaches to RTFC of quantum 
systems are considered. The first one is based on feedback 
employing measurements of some quantum system output 
channel to guide a classical controller [11, 20, 21]. The 
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other feedback approach is a quantum analog of Watt's flyball 
governor — a self-regulating quantum machine. In this sce- 
nario (called coherent RTFC), no measurements with a clas- 
sical output signal are involved, and instead another quantum 
subsystem is employed to facilitate the control action, so that 
the evolution of the composite quantum system, consisting of 
the "plant" (the subsystem of interest) and "controller" (the 
auxiliary subsystem), is coherent [22, 23]. The performance 
of practical RTFC controllers (classical, quantum, or both) can 
be, in principle, optimized using AFC [9], possibly guided by 
an initial OLC design, further enhancing the significance of a 
universal landscape topology common to all quantum control 
approaches. 

In RTFC based on selective measurements of a single quan- 
tum system, the outcome of each measurement is random. Af- 
ter averaging over the random processes corresponding to all 
possible measurement outcomes, feedback control produces 
Kraus-type evolution of the controlled system. In RTFC based 
on measurements of an ensemble of quantum systems, the en- 
semble average produces a Kraus map as well. In coherent 
RTFC, if the plant and controller are initially prepared in a 
product state, the evolution of the plant is once again repre- 
sented by a Kraus map. Therefore, all of these incarnations of 
RTFC generate Kraus-type evolution. Arbitrary Kraus maps 
can be engineered, for example, by using a simple quantum 
measurement combined with coherent feedback actions [24] . 
Adopting a previous analysis [18], we show, under the Kraus- 
map controllability assumption, that quantum control land- 
scapes have no traps for all considered types of RTFC. We 
will start with basic definitions, then prove that each consid- 
ered type of RTFC produces Kraus-type evolution, and, fi- 
nally, use these results to determine the quantum control land- 
scape topology. The conclusion of the Rapid Communication 
will then draw the analysis together for a unified control land- 
scape formulation including OLC, AFC, and RTFC. 

In practically important situations the evolution of an open 
quantum system can be represented by a Kraus map [9, 
19]. For an n-level system, any such map $ can be cast 
as the operator-sum representation (OSR) [19]: = 
J2v=i KupK^l, where p is the density matrix (a positive, unit- 
trace n X n matrix) and {K^}f;^^ is a set of Kraus operators 
(complex n X n matrices satisfying the trace-preserving con- 
dition I^t^^v = I)- The OSR is not unique: Any map 
$ can be represented using infinitely many sets of Kraus oper- 
ators. We denote the set of all Kraus maps by AC„. The Kraus- 
map description of open-system dynamics is very general and 
includes both Markovian and non-Markovian regimes [25]. 

A generalized quantum measurement with A'o possible out- 
comes {Oa} (a = 1,2, ... , Nq) is characterized by a family 
of Kraus operators {A'q ,g}. We denote the set of outcomes 
and corresponding Kraus operators for a given quantum mea- 
surement as O := {Oa, Ka.p}. In particular, the projective 
measurement of a Hermitian observable O = J^a (^a^a with 
eigenvalues Oa and spectral projectors Ha corresponds to the 
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If the measurement starts at time t 



Pa=Tr[j:^KaMt)Klp]- 

When a selective measurement of duration is performed 
and the outcome Oa is observed, the density matrix evolves 
as p{t) Pa{t + Tm), where 



Pa{t + Tni) = — ^ Ka,pp{t)Kl 
Pa ^ 



(1) 



If the measurement is nonselective (i.e., the measurement out- 
come is not observed), the corresponding evolution p{t) — 5- 
p{t + Tm) will be the average over all possible measurement 
outcomes: 

P{t + T^) = ^PaPa{t + T^) = ^ K a,p p{t)Kl^ p. (2) 

The evolution in Eq. (2) defines a Kraus map Vlo : p{t) 
ilo [p(^)] = p{t + Tm), which is completely determined by the 
measurement O. 

In RTFC, the measurement (or, in another variation, the in- 
teraction with an auxiliary quantum "controller") alters the 
evolution of the quantum system at each feedback iteration. 
Thus, the same quantum system is followed in real time in 
the feedback loop. Implementing RTFC on the atomic or 
molecular scale appears to be a very challenging technical 
problem, but its practical realization promises to significantly 
improve the ability to stabilize and control quantum systems. 
Consider now RTFC of a single quantum system, where a 
discrete series of selective measurements is performed and 
each measurement is followed by a feedback action (con- 
tinuous feedback can be treated as the limit of the discrete 
case, resulting in the same control landscape topology). For 
the discrete case, the ith iteration of the feedback process 
consists of a measurement O' with possible outcomes {OJ,} 
at time ti, followed by a feedback action dependent on the 
measurement outcome (the measured observables and feed- 
back actions can be distinct at different iterations). The feed- 
back action may be generally represented by a Kraus map 
that depends on the measurement outcome (a special case of 
the feedback action is a unitary transformation correspond- 
ing to a coherent control). If at the ith iteration the mea- 
surement outcome is observed, then the feedback action 
(of duration Tf) described by the Kraus map AJ^ will be ap- 
plied to the system, so that the density matrix will evolve as 

P{ti) Pa{U+Tn, + Ti) = A'„[pa(t^+rm)], where Pa (ti+Tni) 

is of the form (1), with the corresponding probability p^. 
The map AJ^ also includes the free evolution and influence 
of the environment. The system evolution after one feedback 
iteration, averaged over all possible measurement outcomes, 
p{ti + Tm + Tf) = Y.aPaPai't^ + + Tf), is therefore given 
by the transformation p{ti) p[ti + t,,, + Tf) = $'[/9(t.i)], 
where 



(3) 



and the system density matrix before the measurement is p{t), 
then the probability of the measurement outcome Oa will be 



and {Kj^ ^} are the Kraus operators characterizing the mea- 
surement . Let the OSR of the feedback-action Kraus map 
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be Al^ip) = K,MK,J, where E.iK,JK,a 
I. Then Eq. (3) can be rewritten as 



where 



^l,a^' /3- Since E 



(4) 
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I, the transformation of Eqs. (3) and (4) is a Kraus map. 
Thus, Eq. (4) shows that the average evolution for one feed- 
back iteration is of the Kraus type for arbitrary (generaHzed) 
quantum measurement and any (coherent or incoherent) feed- 
back action. For a special case of a pure, least-disturbing mea- 
surement and a coherent feedback action, this result was ob- 
tained in Ref. [24]. 

The entire feedback process for controlling the system 
from the initial to final time is characterized by a se- 
quence of measurements and feedback actions: F = 
{0^,F^,...,0^,F^}, where O' {i = 1,2,...,A^) is the 
measurement for the ith iteration, = {A^} is the set of 
all feedback actions (Kraus maps) for the ith iteration, and N 
is the number of iterations. Different trials of the feedback 
process will, in general, produce distinct evolutions, result- 
ing in different system states at the final time T. The av- 
erage output of the feedback process is given by averaging 
over all possible evolutions, which produces the transforma- 
tion p{T) = $f[p(0)], where $i? = $^ o • • ■ o $2 □ <j,i jg 
a Kraus map given by the composition of one-iteration Kraus 
maps of the form (4). 

Consider now RTFC of an ensemble of identical quantum 
systems, where measurements record the expectation value 
O = ^i^PaOa ~ Tr[Op(<)] of an observable O. The 
density matrix representing the state of the ensemble under- 
goes a transformation characteristic for a nonselective mea- 
surement (i.e., with averaging over all possible measurement 
outcomes): p{t) — > p{t + t^) = flo[p{t)], where the Kraus 
map rio is defined by Eq. (2). The feedback action condi- 
tioned upon the measured value O is generally represented 
by a Kraus map A^^, so that the ensemble evolution for one 
feedback iteration is p{ti) — > p{ti + + Tf) = $'[p(ti)], 
where the Kraus map = A^ o fi^ is the composition of 
the Kraus maps representing the ensemble measurement and 
feedback action for the ith iteration. Similar to the single- 
system case, the overall transformation for the entire feed- 
back process is p{T) ~ ^p[p{0)], where the Kraus map 
~ $^ o • • ■ o $^ o $1 is again the composition of one- 
iteration Kraus maps. 

Consider now coherent RTFC, where the quantum subsys- 
tem of interest (the plant) interacts with an auxiliary quantum 
subsystem (the controller), and the evolution of the compos- 
ite system is coherent: ptot(r) = U{T)piotiO)W{T). Here, 
Plot and U{T) are the density matrix and the unitary evolution 
operator, respectively, for the composite system. An external 
coherent control field (which is generally time-dependent) can 
act on the plant, controller, or both. The state of the plant 
at any time t is represented by the reduced density matrix 
p{t) = Trc[ptot(0]' where Tr^ denotes the trace over the con- 
troller's degrees of freedom. If the initial state of the compos- 
ite system is in tensor product form, /3tot(0) = p{0) ® jOc(O), 



then the evolution of the plant is represented by a Kraus map: 
p{T) = ^u[p{0)] = j:^K^pmK^y, where the Kraus 
operators depend on the evolution operator U{T) of the 
composite system [19]. 

With the analysis above, we can now assess the topology 
of quantum control landscapes for all considered types of 
RTFC. To be specific, a prevalent problem in quantum con- 
trol is to maximize the expectation value of some target ob- 
servable of the controlled system. As we established above, 
in measurement-based RTFC for both a single quantum sys- 
tem and an ensemble, the average density matrix at the final 
time T is given by p{T) = ^p[p{0)], where the Kraus map 
<I>i? is determined by the set F of measurements and feedback 
actions at all iterations of the feedback process. The goal is 
to find an optimal feedback process i^opt that maximizes the 
expectation value of the target observable A at the final time, 
A{T) = Tr[ip(r)]. The feedback process F plays the role 
of a set of controls, and the objective function has the form: 
J[F] = Tr{i$F[p(0)]}. An OSR of the Kraus map ^p is 
given by $f[p(0)] = ^^P(0)(i^.^)t, where {K^} is a 
set of Kraus operators depending on the feedback process F. 
The objective J[F] can be cast as a function of Kraus opera- 
tors: 



(5) 



We assume that the set T of all available feedback processes 
(i.e., all available measurements and feedback actions) is rich 
enough to produce all possible Kraus maps, i.e., that the sys- 
tem is Kraus-map controllable. For coherent RTFC, the plant 
also undergoes a Kraus-type evolution, p(T) = $t/[p(0)], and 
the control objective A{T) can also be cast as a function of 

the Kraus operators: J[{Klf}] = Tr[Aj2^ p{0){I<i!V], 
which has the same form as Eq. (5). For a sufficiently large 
controller prepared initially in a pure state, evolution-operator 
controllability of the composite system is a sufficient condi- 
tion for Kraus-map controllability of the plant [26]. 

Building on recent OLC and AFC-motivated analysis of 
control landscape topology [18] for a system that is Kraus- 
map controllable, the objective function of the form (5) has 
no local maxima for any initial state p(0) and any Hermitian 
operator A. This result implies that quantum control land- 
scapes for OLC, AFC, measurement-based RTFC, coherent 
RTFC, and combinations thereof, all have the same trap-free 
topology, provided that the available controls are sufficient to 
produce any Kraus map. Furthermore, all local extrema of the 
objective function of the form (5) are saddles [18] that can be 
easily evaded by a suitable algorithm guiding an ascent over 
the landscape. The trap-free control landscape topology is es- 
tablished above in the space of Kraus maps, /C„. The control 
landscape also will be trap-free in the space of actual controls, 
C, if the tangent map from C to /C„ is surjective everywhere 
in C. Although, in general, there exist so-called singular con- 
trols [27] at which surjectivity does not hold, numerical re- 
sults show that their impact on the search for optimal controls 
should be negligible [28]. 

Another important consequence of controllable Kraus-type 
evolution for various types of quantum OLC, AFC and RTFC 
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is the existence of a special control (e.g., for measurement- 
based RTFC, a special feedback process F^,) that is opti- 
mal for all initial states of the system. Let p{T) be the 
state maximizing the target expectation value: Tt[Ap{T)] = 
maxp Tr(Ap), and let the spectral decomposition of this final 
state be p{T) = -Pa I' where pa is the prob- 

ability to find the system in the state \ua)- For an arbitrary 
orthonormal basis in the system's Hilbert space, define 

1 /2 

operators Ka^p = Pa \ua){vi3\. The Kraus map built from 
these operators, $*(jo) — Ka^ppK^^ ^ generates evo- 

lution $,[p(0)] = p{T) for all initial states p(0) [26]. There- 
fore, the control that produces the Kraus map (e.g., for 
measurement-based RTFC, the feedback process F^, E T such 
that = will be optimal for all initial states and this 
control will be robust to variations of the initial system state. 

This work shows that the operationally and technologically 
distinct quantum control approaches of OLC, AFC, and RTFC 
share, under the condition of Kraus-map controllability, a uni- 
fied control landscape structure implying two common funda- 



mental properties. First, all such control schemes are charac- 
terized by the absence of landscape traps, with all local ex- 
trema being saddles. Second, special controls exist which are 
universally optimal for all initial states. These findings estab- 
lish that (1) there are no inherent landscape features hindering 
attainment of the highest possible control yield and (2) suit- 
able controls can provide broad scale robustness to variations 
of the initial conditions. Moreover, these properties are valid 
for any quantum control scheme which produces Kraus-type 
evolution of the system, including feedback-based and open- 
loop approaches, as well as their combinations. The unifica- 
tion of these seemingly different approaches at a conceptual 
level (see figures in supplementary material [9]) should, in 
turn, provide a basis to ultimately unite the currently distinct 
laboratory realizations of quantum feedback control and open- 
loop control to attain the best performance under all possible 
conditions. 

This work was supported by NSF and ARO. 
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FIG. 1: Outline of different quantum control schemes, all of which aim at achieving a target physical objective by actively manipulating the 
dynamics of a quantum system, (a) In open-loop control (OLC), a theoretical model of the system dynamics is used to design the control field 
(e.g., employing optimal control theory). This control design is then directly applied in the laboratory [1, 2]. This approach can be satisfactory 
for some simple systems; however, in more complex situations, the model-based design is usually not optimal for the actual system [3]. (b) In 
adaptive feedback control (AFC), the objective is measured at each iteration and the result is fed back to a learning algorithm that uses previous 
observations to propose a new (ideally, better) control [4]. At the end of each trial, after the control is applied and the objective is measured, 
the system is reset to its initial state for the next iteration. This resetting makes the back action of the measurement irrelevant. In recent years, 
AFC has become a routine procedure that is successfully used in many laboratories for control of various quantum phenomena [3, 5, 6]. Of 
particular importance is the ability of AFC to function in the laboratory in situations when the Hamiltonian of a complex quantum system and 
its environment are not well known, (c) In the measurement-based type of real-time feedback control (RTFC), measurements are employed 
to probe the quantum system, and the obtained information is processed classically in real time to select the next control action [7~11]. 
In this scheme, the system evolution during each feedback iteration is affected not only by the coherent control action (conditioned upon the 
measurement outcome), but also by incoherent back-action exerted by the measurement. Variations of RTFC with both discrete and continuous 
measurements were studied [10]. An important factor in considering laboratory implementation of RTFC on the atomic or molecular scale is 
the issue of loop latency arising due to the fact that many interesting quantum phenomena occur on a time scale which is too short to allow 
for processing of the measured data in classical controllers based on conventional electronics, (d) In coherent RTFC, the evolution of the 
primary quantum system (the "plant") is manipulated through its interaction with an auxiliary quantum system (the "controller") [12-14]. 
The evolution of the composite quantum system which consists of the plant and controller is unitary (assuming that environmental effects are 
neglected). Optionally, the plant, controller, or both can be also coherently driven by external classical control fields (e.g., designed based 
on a theoretical model of the composite system dynamics, as in OLC). The optional external control module is shown within the dashed box. 
While coherent RTFC can overcome the latency issue, the quantum controller itself may require precise engineering to assure quality control 
performance of the plant. 
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FIG. 2: Outline of a prospective iiybrid sclieme of quantum control [15]. Since all quantum control approaches, including OLC, AFC, and 
different types of RTFC, share the same trap-free control landscape topology, it would be possible to consistently maximize the attainment 
of a target physical objective by utilizing a hybrid control scheme. Such a hybrid scheme would benefit from synergetic contributions of all 
components tuned to achieve the highest degree of control over the quantum dynamics. In particular, it can incorporate coherent RTFC which 
employs the interaction of the plant (the primary quantum system) with a quantum controller. Additionally, both the plant and controller can 
be manipulated by coherently driving them with external classical control fields. In order to improve the effectiveness of external controls, a 
measurement-based RTFC loop can be implemented, in which the quantum system is probed at each feedback iteration to assess the best next 
control action. Moreover, quantum measurement back-action can be employed as an additional non-unitary control. The overall performance 
of the control system can be optimized in the AFC loop, with the measurement of the objective followed, at the end of each trial, by resetting 
the system to its initial state. AFC can be very useful for optimizing designs and operational conditions of both quantum and classical 
controllers employed in coherent and measurement-based RTFC, respectively. While model-based theoretical control designs utilized in OLC 
will typically not be optimal for actual complex quantum systems in the laboratory, they can serve as initial trial fields in the closed-loop 
optimization as well as play an important role in exploring the feasibility of various control outcomes. The order, in which the components of 
a hybrid control scheme are implemented, can vary depending on practical circumstances. 



Kraus maps 



The density matrix p representing the state of an n-level quantum system is a positive, unit-trace n x n matrix. We denote 
by Mn = C"^" the set of all n x rt complex matrices, and by P„ := {p e Mn \ P = p\ P > ^, Tr(p) = 1} the set of all 
density matrices. A map $ : Mn Mn is positive if <i>(p) > for any p > in Mn- A map $ : Mn Mn is completely 
positive (CP) if for any / e N the map $ (g) I; : Mn ® Mi Mn <X) Mi is positive (I; is the identity map in Mi). A CP map is 
trace-preserving if Tr[$(p)] = Tr(yo) for any p G Mn- We denote by ICn the set of all CP, trace-preserving maps acting in Mn, 
referred to as Kraus maps or quantum operations [16-18]. 
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